Skip to content

Spec uncertainty engine + repoint ledger to @rafters#104

Merged
ssilvius merged 2 commits intomainfrom
feat/uncertainty-engine-spec
Apr 27, 2026
Merged

Spec uncertainty engine + repoint ledger to @rafters#104
ssilvius merged 2 commits intomainfrom
feat/uncertainty-engine-spec

Conversation

@ssilvius
Copy link
Copy Markdown
Contributor

Summary

  • Spec for the uncertainty engine -- the AI honesty layer for the studio. Generic input -> prediction -> outcome ledger; per-cohort Brier scores and reliability diagrams; five-state lifecycle (emitted, witnessed, calibrated, orphaned, retired). See docs/designs/uncertainty-engine.md.
  • Repoint @ezmode-games/drizzle-ledger -> @rafters/ledger@0.2.0. The CLAUDE.md rewrite (3c6e23b) missed apps/web/src/api/auth.ts and the package.json declarations, leaving main with a broken typecheck. Restored to green.

The institutional read

Other agents build models. Platform audits them. Every confidence number Rafters publishes is grounded in a published reliability record. Same ethic as publishing the revenue split.

The orphan state is load-bearing: silence is its own state, scored separately, surfaced as a metric. Treating silence as agreement poisons calibration upward; treating it as disagreement poisons it downward. Naming it removes the choice.

Phase 1 work breakdown

Issues #97-#103:

Test plan

  • Spec reads cleanly; tables render in GitHub
  • pnpm typecheck passes (verified locally)
  • pnpm install clean against @rafters/ledger@0.2.0
  • better-auth ledgerPlugin import resolves at runtime (smoke test on next deploy)

ssilvius and others added 2 commits April 26, 2026 19:52
…rtainty engine

The CLAUDE.md rewrite (3c6e23b) updated some ledger imports but
missed apps/web/src/api/auth.ts and the package.json declarations,
leaving the workspace in a broken typecheck state -- the old
package no longer resolves on the registry. Swap to @rafters/ledger
across auth.ts, apps/web/package.json, and the root
onlyBuiltDependencies list. Typecheck restored to green.

Add docs/designs/uncertainty-engine.md -- design for the AI honesty
layer. Generic input -> prediction -> outcome ledger, per-cohort
Brier and reliability diagrams, five-state lifecycle (emitted,
witnessed, calibrated, orphaned, retired). Phase 1 unblocks rafters
by replacing the ezmode CORE_API ghost binding with a real platform
endpoint.

Issues #97-103 break out the Phase 1 work.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Local lint, format:check, and frozen-lockfile install all pass clean
on this commit. CI failure on the prior run looks transient.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
@ssilvius ssilvius merged commit beff9d7 into main Apr 27, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant